Computation in Sofic Quantum Dynamical Systems 



o 
o 

(N 
Oh- 

<: 

m ; 

S : 

H— > ■ 

c ■ 

ctf ■ 
=5 

cr 



> 
in 

o 

m 

o 
l> 
o 



X 



Karoline Wiesner 1: El and James P. Crutchfield 1 '0 

1 Center for Computational Science & Engineering and Physics Department, 
University of California Davis, One Shields Avenue, Davis, CA 95616 

We analyze how measured quantum dynamical systems store and process information, introduc- 
ing sofic quantum dynamical systems. Using recently introduced information-theoretic measures 
for quantum processes, we quantify their information storage and processing in terms of entropy 
rate and excess entropy, giving closed-form expressions where possible. To illustrate the impact of 
measurement on information storage in quantum processes, we analyze two spin-1 sofic quantum 
systems that differ only in how they are measured. 



I. INTRODUCTION 

Extending concepts from symbolic dynamics to the 
quantum setting, we forge a link between quantum dy- 
namical systems and quantum computation, in general, 
and with quantum automata, in particular. 

Symbolic dynamics originated as a method to study 
general dynamical systems when, nearly 100 years ago, 
Hadamard used infinite sequences of symbols to analyze 
the structure of geodesies on manifolds of negative cur- 
vature; see Ref. [l| and references therein. In the 1930's 
and 40 's Hedlund and Morse coined the term symbolic 
dynamics 0, H[ to describe the study of dynamics over 
the space of symbol sequences in their own right. In the 
1940's Shannon used sequence spaces to describe infor- 
mation channels Subsequently, the techniques and 
ideas have found significant applications beyond dynam- 
ical systems, in data storage and transmission, as well as 
in linear algebra 

On the flip side of the same coin, computation theory 
codes symbol sequences using finite-state automata. The 
class of sequences that can be coded this way define the 
regular languages [||. It turns out that many dynamical 
systems can also be coded with finite-state automata us- 
ing the tools of symbolic dynamics [f|. In fact, Sofic sys- 
tems are the particular class of dynamical systems that 
are the analogs of regular languages in automata theory. 

The study of quantum behavior in classically chaotic 
systems is yet another active thread in dynamical sys- 
tems 0, IH which has most recently come to address the 
role of measurement. Measurement interaction leads to 
genuinely chaotic behavior in quantum systems, even far 
from the semi-classical limit @ . Classical dynamical sys- 
tems can be embedded in quantum dynamical systems 
as the special class of commutative dynamical systems, 
which allow for unambiguous assignment of joint proba- 
bilities to two observations [lfj. 

An attempt to construct symbolic dynamics for quan- 
tum dynamical systems was made by Alicki and Fannes 
[l(|, who defined shifts on spin chains as the analog of 
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shifts in sequence space. Definitions of entropy followed 
from this. However, no connection to quantum finite- 
state automata was established there. 

In the following we develop an approach that differs 
from this and other previous attempts since it explic- 
itly accounts for observed sequences, in contrast to se- 
quences of (unobservable) quantum objects, such as spin 
chains. The recently introduced computational model 
class of quantum finite-state generators provides the re- 
quired link between quantum dynamical systems and the 
theory of automata and formal languages [III- It gives 
access to an analysis of quantum dynamical systems in 
terms of symbolic dynamics. Here, we strengthen that 
link by studying explicit examples of quantum dynam- 
ical systems. We construct their quantum finite-state 
generators and establish their sofic nature. In addition 
we review tools that give an information-theoretic analy- 
sis for quantifying the information storage and processing 
of these systems. It turns out that both the sofic nature 
and information processing capacity depend on the way 
a quantum system is measured. 



II. QUANTUM FINITE-STATE GENERATORS 

To start, we recall the quantum finite-state generators 
(QFGs) defined in Ref. [llj. They consist of a finite set 
of internal states Q = : i — 1, . . . , |Q|}. The state 
vector is an element of a |Q|-dimensional Hilbert space: 
(-01 eH. At each time step a quantum generator outputs 
a symbol s S A and updates its state vector. 

The temporal dynamics is governed by a set of | tri- 
dimensional transition matrices {T(s) — U-P(s), s £ A}, 
whose components are elements of the complex unit disk 
and where each is a product of a unitary matrix U and a 
projection operator P(s). U is a \Q\ -dimensional unitary 
evolution operator that governs the evolution of the state 
vector ("01 . P = {P(s) : s £ .4} is a set of projection oper- 
ators — |Q|-dimensional Hermitian matrices — that deter- 
mines how the state vector is measured. The operators 
span the Hilbert space: -P( s ) = 1- 

Each output symbol s is identified with the measure- 
ment outcome and labels one of the system's eigenvalues. 
The projection operators determine how output symbols 
are generated from the internal, hidden unitary dynam- 
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ics. They are the only way to observe a quantum pro- 
cess's current internal state. 

A quantum generator operates as follows. Uij gives 
the transition amplitude from internal state qi to internal 
state qj. Starting in state vector (-00 1 the generator up- 
dates its state by applying the unitary matrix U . Then 
the state vector is projected using P{s) and renormal- 
ized. Finally, symbol s £ A is emitted. In other words, 
starting with state vector {-00 1 , a single time-step yields 
(ip(s)\ = (V>ol U ■ P(s), with the observer receiving mea- 
surement outcome s. 



A. Process languages 

The only physically consistent way to describe a quan- 
tum system under iterated observation is in terms of 

the observed sequence S= ■ ■ ■ S- 2 S-iS Si . . . of dis- 
crete random variables S t - We consider the family of 
word distributions, {Pr(st+i, . . . , S{+i) : s t 6 .4}, where 
Pr(st) denotes the probability that at time t the ran- 
dom variable St takes on the particular value St € A 
and Pr(st+i, . . . , st+h) denotes the joint probability over 
sequences of L consecutive measurement outcomes. We 
assume that the distribution is stationary: 



Pr(5 t+ i, . . . , St+h) = Pr(Si, . . . , S L ) 



(1) 



We denote a block of L consecutive variables by S L = 
Si . . . Sl and the lowercase s L — sis 2 ■ • ■ sl denotes a 
particular measurement sequence of length L. We use the 
term quantum process to refer to the joint distribution 

Pr(5) over the infinite chain of random variables. A 
quantum process, defined in this way, is the quantum 
analog of what Shannon referred to as an information 
source (T^. 

Such a quantum process can be described as a stochas- 
tic language C, which is a formal language with a prob- 
ability assigned to each word. A stochastic language's 
word distribution is normalized at each word length: 



VPr(s L ) = l ,L= 1,2,3,. 



{s L ec} 



(2) 



with < Pr(s L ) < 1 and the consistency condition 
Pr(s L ) < Pr(s L s). 

A process language is a stochastic language that is sub- 
word closed: all subwords of a word are in the language. 

We can now determine word probabilities produced by 
a QFG. Starting the generator in (^>q|, the probability 
of output symbol s is given by the state vector without 
renormalization: 



Pr(a) = (V>(s)Ws)} 



(3) 



While the probability of outcome s L from a measurement 
sequence is 



In [ll| the authors established a hierarchy of process 
languages and the corresponding quantum and classi- 
cal computation-theoretic models that can recognize and 
generate them. 



B. Alternative quantum finite-state machines 

Said most prosaically, we view quantum generators as 
representations of the word distributions of quantum pro- 
cess languages. Despite similarities, this is a rather dif- 
ferent emphasis than that used before. The first men- 
tion of quantum automata as an empirical description of 
physical properties was made by Albert in 1983 [131 ]. Al- 
bert's results were subsequently criticized by Peres for 
using an inadequate notion of measurement [Til ]. In a 
computation-theoretic context, quantum finite automata 
were introduced by several authors and in varying ways, 
but all as devices for recognizing word membership in a 
language. For the most widely discussed quantum au- 
tomata, see Refs. [HI, [TH, IT?}. Ref. [H[ summarizes the 
different classes of languages which they can recognize. 
Quantum transducers were introduced by Freivalds and 
Winter [l!|. Their definition, however, lacks a physical 
notion of measurement. We, then, introduced quantum 
finite-state machines, as a type of transducer, as the gen- 
eral object that can be reduced to the special cases of 
quantum recognizers and quantum generators of process 
languages [TTI ] . 



III. INFORMATION PROCESSING IN A SPIN-1 
DYNAMICAL SYSTEM 

We will now investigate concrete examples of quantum 
processes. Consider a spin-1 particle subject to a mag- 
netic field which rotates the spin. The state evolution 
can be described by the following unitary matrix: 



U 



-J- J- 

0-1 
L J_ o 

V2 V2 



(5) 



Since all entries are real, U defines a rotation in K 3 
around the y-axis by angle j followed by a rotation 
around the x-axis by an angle -|. 

Using a suitable representation of the spin operators 
J* 0, p. 199]: 





Pr( S L ) = (^(s L )\i;( S L )) 



(4) 



(G) 



the relation Pi = 1 — jf defines a one-to-one correspon- 
dence between the projector Pi and the square of the spin 
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FIG. 1: The Golden Mean quantum generator. 

component along the i-axis. The resulting measurement 
answers the yes-no question, Is the square of the spin 
component along the z-axis zero? 

Consider the observable Jy. Then the following pro- 
jection operators together with U in Eq. ((5|) define the 
quantum finite-state generator: 

P(0) = |010) (010| 
and P(l) = 1 100) (100| + |001) (001| . (7) 

A graphical representation of the automaton is shown 
in Fig. m 

The process language generated by this QFG is the 
so-called Golden-Mean Process language [l|. The word 
distribution is shown in Fig. [21 It is characterized by the 
set of irreducible forbidden words T — {00}: no consec- 
utive zeros occur. In other words, for the spin-1 particle 
the spin component along the y-axis never vanishes twice 
in a row. This restriction — the dominant structure in the 
process — is a short-range correlation since the measure- 
ment outcome at time t only depends on the immediately 
preceding one at time t — 1. If the outcome is 0, the next 
outcome will be 1 with certainty. If the outcome is 1, the 
next measurement is maximally uncertain: outcomes 
and 1 occur with equal probability. 

Consider the same Hamiltonian, but now use instead 
the observable J 2 . The corresponding projection opera- 
tors define the QFG: 

P(0) = 1 100) <100| 
and P(l) = |010) <010| + |001) <001| . (8) 

The QFG defined by U and these projection operators 
is shown in Fig. [3J The process language generate d by 
this QFG is the so-called Even Process language [l|, l2l| . 
The word distribution is shown in Fig. 2J It is de- 
fined by the infinite set of irreducible forbidden words 
T = {Ol^^O}, k = 1, 2, 3, .... That is, if the spin com- 
ponent equals along the x-axis it will be zero an even 
number of consecutive measurements before being ob- 
served to be nonzero. This is a type of infinite corre- 
lation: For a possibly infinite number of time steps the 




FIG. 2: Golden Mean process language: Word {00} has zero 
probability; all others have nonzero probability. The loga- 
rithm base 2 of the word probabilities is plotted versus the bi- 
nary string s L , represented as base-2 real number "0.s L " . To 
allow word probabilities to be compared at different lengths, 
the distribution is normalized on [0, 1] — that is, the probabil- 
ities are calculated as densities. 
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FIG. 3: The Even Process quantum generator. 



system tracks the evenness or oddness of number of con- 
secutive measurements of "spin component equals along 
the x-axis". 

Note that changing the measurement, specifically 
choosing J 2 as the observable, yields a QFG that gen- 
erates Golden Mean process language again. 

The two processes produced by these quantum dynam- 
ical systems are well known in the context of symbolic dy- 
namics Q — a connection we will return to shortly. Let 
us first, though, turn to another important property of 
finite-state machines and explore its role in computa- 
tional capacity and dynamics. 
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dynamics. Once they are known and one is synchro- 
nized, the process becomes optimally predictable. A fi- 
nal, related reason why determinism is desirable is that 
closed-form expressions can be given for various informa- 
tion processing measures, as we will discuss in Sec. I VII 




FIG. 4: Even Process language: Words {01 2fe_1 0},fc = 
1,2,3, ... have zero probability; all others have nonzero prob- 
ability. 



IV. DETERMINISM 

The label determinism is used in a variety of senses, 
some of which are seemingly contradictory. Here, 
we adopt the notion, familiar from automata theory 
@, which differs from that in physics, say, of non- 
stochasticity. One calls a finite-state machine (classical 
or quantum) deterministic whenever the transition from 
one state to the next is uniquely determined by the out- 
put symbol, or input symbol for recognizers. It is impor- 
tant to realize that a deterministic finite-state machine 
can still behave stochastically — stochasticity here refer- 
ring to the positive probability of generating symbols. 
Once the symbol is determined, though, the transition 
taken by the machine to the next state is unique. Thus, 
what is called a stochastic process in dynamical systems 
theory can be described by a deterministic finite-state 
generator without contradiction. 

We can easily check the two quantum finite-state ma- 
chines in Figs.[T]and[3]for determinism by inspecting each 
state and its outgoing transitions. One quickly sees that 
both generators are deterministic. In contrast, the third 
QFG mentioned above, defined by U in Eq. ([5]) and Jf , 
is nondctcrministic. 

Determinism is a desirable property for various rea- 
sons. One is the simplicity of the mapping between ob- 
served symbols and internal states. Once the observer 
synchronizes to the internal state dynamics, the output 
symbols map one-to-one onto the internal states. In gen- 
eral, though, the observed symbol sequences do not track 
the internal state dynamics (orbit) directly. (This brings 
one to the topic of hidden Markov chains [221].) 

For optimal prediction, however, access to the internal 
state dynamics is key. Thus, when one has a determin- 
istic model, the observed sequences reveal the internal 



SOFIC SYSTEMS 



In symbolic dynamics, sofic systems are used 
as tractable representations with which to analyze 
continuous-state dynamical systems 0, Let the al- 
phabet A together with annxn adjacency matrix (with 
entries or 1) define a directed graph G = (V, E) with V 
the set of vertices and E the set of edges. Let X be the 
set of all infinite admissible sequences of edges, where ad- 
missible means that the sequence corresponds to a path 
through the graph. Let T be the shift operator on this 
sequence; it plays the role of the time-evolution operator 
of the dynamical s yste m. A sofic system is then defined 
as the pair (X, T) [23| • The Golden Mean and the Even 
process are standard examples of sofic systems. The Even 
system, in particular, was introduced by Hirsch et al in 
the 1970s [2l|. 

Whenever the rule set for admissible sequences is finite 
one speaks of a subshift of finite type. The Golden Mean 
process is a subshift of finite type. Words in the language 
are defined by the finite (single) rule of not containing the 
subword 00. The Even Process, on the other hand, is not 
of finite type, since the number of rules is infinite: The 
forbidden words {01 2fe+1 0} cannot be reduced to a finite 
set. As we noted, the rule set, which determines allowable 
words, implies the process has a kind of infinite memory. 
One refers, in this case, to a strictly sofic system. 

The spin-1 example above appears to be the first time 
a strictly sofic system has been identified in quantum dy- 
namics. This ties quantum dynamics to languages and 
quantum automata theory in a way similar to that found 
in classical dynamical systems theory. In the latter set- 
ting, words in the sequences generated by sofic systems 
correspond to regular languages — languages recognized 
by some finite-state machine. We now have a similar 
construction for quantum dynamics. For any (finite- 
dimensional) quantum dynamical system under observa- 
tion we can construct a QFG, using a unitary operator 
and a set of projection operators. The language it gen- 
erates can then be analyzed in terms of the rule set of 
admissible sequences. One interesting open problem be- 
comes the question whether the words produced by sofic 
quantum dynamical systems correspond to the regular 
languages. An indication that this is not so is given by 
the fact that finite-state quantum recognizers can accept 
nonregular process languages . 
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VI. INFORMATION-THEORETIC ANALYSIS 

The process languages generated by the spin-1 particle 
under a particular observation scheme can be analyzed 
using well known information-theoretic quantities such as 
Shannon block entropy and entropy rate fl2| and others 
introduced in Ref. [2J]. Here, we will limit ourselves to 
the excess entropy. The applicability of this analysis to 
quantum dynamical systems has been shown in Ref. [25[ , 
where closed-form expressions are given for some of these 
quantities when the generator is known. 

We can use the observed behavior, as reflected in the 
word distribution, to come to a number of conclusions 
about how a quantum process generates randomness and 
stores and transforms historical information. The Shan- 
non entropy of length-!/ sequences is defined 

H(L) = - £ Pr(s L )log 2 Pr( S L ) . (9) 

s L eA L 

It measures the average surprise in observing the "event" 
s L . Ref. [24[ showed that a stochastic process's informa- 
tional properties can be derived systematically by taking 
derivatives and then integrals of H(L), as a function of 
L. For example, the source entropy rate is the rate of 
increase with respect to L of the Shannon entropy in the 
large- L limit: 

hp = lim [H{L) - H(L - 1)] , (10) 

L — >oo 

where the units are bits/measurement 

Ref. [25j showed that the entropy rate of a quantum 
process can be calculated directly from its QFG, when 
the latter is deterministic. A closed-form expression for 
the entropy rate in this case is given by: 

|Q|-1|Q|-1 

K = -IQI" 1 £ £ l^| 2 log 2 \U t] \ 2 , (11) 

i=0 j=0 

The entropy rate quantifies the irreducible random- 
ness in processes: the randomness that remains after the 
correlations and structures in longer and longer sequences 
are taken into account. 

The latter, in turn, is measured by a complementary 

quantity. The amount I(S] S) of mutual information [l2T | 

shared between a process's past S and its future S is 
given by the excess entropy E [24j . It is the subextensive 
part of H(L): 

E = lim [H(L) - h^L] . (12) 

L — >oo 

Note that the units here are bits. 

Ref. [24| gives a closed-form expression for E for order- 
R Markov processes — those in which the measurement 
symbol probabilities depend only on the previous R — 1 
symbols. In this case, Eq. (fl"2")) reduces to: 

E = H(R) -R-hfj, , (13) 



\^ LldllL mil 

Dynamical System 


Spin-1 
Particle 


Observable 


J 2 

.Jy 


Ji 


[bits/measurement] 
E [bits] 


0.666 
0.252 


0.666 
0.902 



TABLE I: Information storage and generation for example 
quantum processes: entropy rate ft M and excess entropy E. 

where H(R) is a sum over \A\ R terms. Given that the 
quantum generator is deterministic we can simply employ 
the above formula for and compute the block entropy 
at length R to obtain the excess entropy for the order- R 
quantum process. 

Ref. (2f| computes these entropy measures for various 
example systems, including the spin-1 particle. The re- 
sults are summarized in Table [T] The value for the excess 
entropy of the Golden Mean process obtained by using 
Eq. (|13p agrees with the value obtained from simulation 
data, shown in Table |U The entropy — 2/3 bits per 
measurement for both processes, and thus they have the 
same amount of irreducible randomness. The excess en- 
tropy, though, differs markedly. The Golden Mean pro- 
cess (Jy measured) stores, on average, E w 0.25 bits at 
any given time step. The Even Process (Jj measured) 
stores, on average, E w 0.90 bits, which reflects its longer 
memory of previous measurements. 



VII. CONCLUSION 

We have shown that quantum dynamical systems store 
information in their dynamics. The information is ac- 
cessed via measurement. Closer inspection would suggest 
even that information is created through measurement. 
In any case, the key conclusion is that, since both pro- 
cesses are represented by a 3-state QFG constructed from 
the same internal quantum dynamics, it is the means 
of observation alone that affects the amount of memory. 
This was illustrated with the particular examples of the 
spin-1 particle in a magnetic field. Depending on the 
choice of observable the spin-1 particle generates differ- 
ent process languages. We showed that these could be 
analyzed in terms of the block entropy — a measure of 
uncertainty, the entropy rate — a measure of irreducible 
randomness, and the excess entropy — a measure of struc- 
ture. Knowing the (deterministic) QFG representation, 
these quantities can be calculated in closed form. 

We established a connection between quantum au- 
tomata theory and quantum dynamics, similar to the 
way symbolic dynamics connects classical dynamics and 
automata. By considering the output sequence of a re- 
peatedly measured quantum system as a shift system we 
found quantum processes that are sofic systems. Taking 
one quantum system and observing it in one way yields 
a subshift of finite type. Observing it in a different way 
yields a (strictly sofic) subshift of infinite type. Conse- 
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quently, not only the amount of memory but also the 
soficity of a quantum process depend on the means of 
observation. 

This can be compared to the fact that, classically 
the Golden Mean and the Even sofic systems can be 
transformed into each other by a two-block map. The 
adjacency matrix of the graphs is the same. A similar 
situation arises here. The unitary matrix, which is the 
corresponding adjacency matrix of the quantum graph, 
is the same for both processes. The processes can be 
transformed into each other by expressing one set of 
projection operators in the eigenbasis of the other. This 
transformation always exists since the operators simply 
represent different orthonormal basis sets spanning the 
Hilbert space. 



The preceding attempted to forge a link between quan- 
tum dynamical systems and quantum computation by 
extending concepts from symbolic dynamics to the quan- 
tum setting. We believe the results suggest further study 
of the properties of quantum finite-state generators and 
the processes they generate is necessary and will shed 
light on a number of questions in quantum information 
processing. One open technical question is whether sofic 
quantum systems are the closure of quantum subshifts of 
finite- type, as they are for classical systems [2a |. There 
are indications that this is not so. For example, as 
we noted, quantum finite-state recognizers can recognize 
nonregular process languages [Tl| . 
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